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The  stability  of  a  finite  difference  scheme  is  related  explicitly  to  the 
stability  of  the  continuous  problem  being  solved.  At  times,  this  gives 
materially  better  estimates  for  the  stability  constant  than  those  obtained  by 
the  standard  process  of  appealing  to  the  stability  of  the  numerical  scheme  for 
the  associated  initial  value  problem. 
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SIGNIFICANCE  AND  EXPLANATION 


A  popular  explanation  of  the  stability  of  finite  difference  schemes  for 
tw<^- point  boundary  value  problens  relates  it  to  the  stability  of  the 
associated  initial  value  problem*  in  effect,  use  is  made  of  the  simple  fact 
that,  on  a  finite  dimensional  linear  space  (vis.  the  nullspace  of  the 
differential  operator)  and  in  any  norm,  any  linear  map  is  bounded, 
numerically,  the  argument  is  equivalent  to  solving  the  problem  by  shooting. 
But,  much  as  multiple  shooting  often  is  necessary  to  overcome  the  large 
stability  constant  of  the  initial  value  problem,  so  other  means  should  or  must 
be  employed.  Knowledge  of  this  constant  is  important  for  judging  the 
condition  of  the  numerical  scheme.  Also,  when  solving  a  problem  on  an 
infinite  interval  by  truncation,  it  is  important  to  know  just  how  the 
stability  constant  depends  on  the  interval  on  which  the  problem  is  being 
solved. 

In  this  note,  we  carry  out  this  idea  for  a  first-order  system  of  linear 
ordinary  differential  equations  and  for  one-step  methods.  The  slightly  more 
complicated  case  of  multistep  methods  for  a  system  of  m-th  order  equations  is 
treated  in  the  companion  paper  de  Boor  &  de  Hoog  [198?].  No  mesh  restric¬ 
tions,  such  as  uniformity  or  quasi-uniformity,  are  imposed. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  authors  of  this  report. 


The  stability  of  ona-stsp  schemes  for  first-order  two-point 
boundary  value  problems 
by 

C.  da  Boor*,  P.  da  Hoog**  and  H-.  B.  Kallar 

1*  Introduction.  To  paraphraaa  the  first  santsnea  in  the  preface  to  Raudkivi 
[1980] ,  the  stability  of  finite  difference  schemes  for  two-point  boundary  value 
problsaw  "is  well  understood,  but  tar  tram  explained*”  A  papular  explanation  (see, 
e.g.,  Keller  [1976],  Keller  6  White  [1975],  and  a  typical  use  in  Isser  t  wiederdrenk 
[1980]  or  Lynch  (  Rice  [1980])  relates  it  to  the  stability  of  the  associated  initial 
value  problem.  In  effect,  use  is  made  of  the  siuple  fact  that,  on  a  finite  dimens¬ 
ional  linear  space  (vis.  the  nullspace  of  the  differential  operator)  and  in  any 
non,  any  linear  aap  is  bounded.  Muuerically,  the  arpuent  is  equivalent  to  solving 
the  problem  by  shooting.  But,  such  as  multiple  shooting  often  is  necessary  to  over¬ 
come  the  large  stability  constant  of  the  initial  value  prubleai,  so  other  means 
should  or  must  be  employed  if  one  is  actually  after  the  precise  stability  constant 
of  the  difference  scheme  employed.  Knowledge  of  this  constant  is  important  for 
judging  the  condition  of  the  numerical  schema.  Also,  when  solving  a  problem  on  an 
Infinite  interval  by  truncation,  it  is  important  to  know  just  how  the  stability 
constant  depends  on  the  interval  on  which  the  problem  is  being  solved. 
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Mw  abvlOM  mvm  for  this  information  is  ths  stability  constant  of  tha  eon- 
ms  problem.  Usually,  ths  stability  constant  of  ths  numerical  schons  approaches 


that  of  ths  cent! noons  problsm  as  ths  osshsiss  poos  to  ssro  and  hones  can  bo 
inferred  from  the  latter*  ibis  ides  is  implicit  in  Kroiss*  (1972]  treatment  of 
finite  diffsrenos  schemes.  Iks  Soviet  literature*  as  exemplified  by  Kantorovich  a 
Akilov  (19*4] *  nans  this  idea  explicitly  in  the  abstract  treatment  of  projection 
methods  for  tbs  solstice  of  asoond  kind  equations.  Zt  can  also  be  found  in  the 
literature  ehieh  folloms  Steam!  (e.g.  *  origorieff  (1970)). 

Xn  this  note*  ue  carry  out  this  idea  for  a  first-order  system  of  linear  ordina¬ 
ry  differential  equations  and  for  one-stop  methods.  The  slightly  more  complicated 
case  of  anltietep  methods  for  a  system  of  m*th  order  equations  is  treated  in  the 
companion  paper  do  Soar  A  do  Bsos  [1987].  so  nosh  restrictions*  such  as  uniformity 
or  qoasi-nniformity ,  are  imposed. 

ma  consider  the  problem  of  finding  the  n- vector  valued  function  yt(0,T]  — >  tP 
which  satisfies  the  differential  equation 

hr  •  t  d.la) 

with  side  condition 

By  -  b  .  (1.1b) 

Bore*  L  is  the  first  order  linear  differential  operator 

hr  *•  y*  -  Ay 

with  Ai  [0*T]  — >  «***  eontineoea,  and 

sy  «•  S0y(0)  ^yCT)  , 

with  lg*  if  S  tP**  «  The  function  fi[0*T)  — >  tP  and  the  n-vector  b  are  given. 

Zt  is  wall  known  (see*  e.g.,  Keller  (1976ip.1))  that  (1.1)  has  a  solution  if 
and  only  if  tha  matrix  ST  is  aonsingnlar,  with  Y  any  fundamental  matrix  for  L  , 

le#e  § 

YiIO.T]  — >  »B,,,  such  that  LY  -  0  . 
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In  particular,  mi  that  V  is  tha  fundanantal  uatrix  associated  with  tha  Initial 
value  problon,  i.a. , 

T«10,T]  — >  W**1  ,  iy  •  0  ,  Y(0)  -  1  . 

Further  imm  that  BY  is  invartible.  Than,  for  any  y  C  (i^1  *  10, T]  f  , 

y  -  *By  ♦  /0T  G(»,a)(Ly)(s)  da  (1.2) 

with 

6(t)  »-  Y(t) (BY)"1  (1.3a) 


f  *(t>  BC 

6(t,s)  i-  (  1 

V  -*(t)  B. 


•(0)  Ms)”1  ,  0<a<t 

•(»)  «»)’f  ,  t<s<T 


(1.3b) 


Knowledge  of  Y  ,  hanoa  of  Groan's  function  Q  ,  nairas  it  poaslbla  to  calculate 
stability  constanta.  Danota  by  |  *|  any  convenient  nom  in  &  as  wall  as  tbs 
corresponding  natrlx  nom.  Also,  let 


*yip  «•  C«  ly<t)lpdt),/p  , 

with  lyl—  i«  suptetly(t)|  its  Uniting  wall  as  p — >  •  .  Than  (1.2)  inpliea 
tha  diffarantial  stability  relation 

'T'.  «  *l»yl  ♦  c  fcyl  ,  (1.4) 

p  p 

with  interior  stability  constant 


and  aide 


cp  »•  sup  G(«,s)s(s)dsl,/lslp  I  s  «  (tptO,T]  f) 
-  <UJ  |6C.s)|^ds]1/,l-  ,  1/p  ♦  1/q  -  1  , 

.tim  stability  omt it 

JC  i-  I6I—  . 


(1.5a) 


(1.5b) 


Of  particular  interest  for  us  ars  tha  special  choices  p  •  1,  •  which  glwa 

C1  “  ,c,«  *  o.  ■  ijJlOC.sHdal.,  (1.6) 

and  correspond  to  insuring  tha  slsa  of  Ay,  i.a.,  of  f  in  (1.1),  by  Ifl,  and 
•f raspactiwaly.  It  is  worthwhile  to  consider  both  these  choieea,  as  tha 
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following  «wpl«  illustrates,  ChooM 


Fran  this,  on*  calculates 

X  -  1  *  e"T  ,  e,  ■  1  ,  am  -  2(1  -  a"*'2)  . 

If  *  is  not  large,  than  p  ■  1  is  s  desirable  ehoics  bsosnss  it  sliows  f  -  Ly 
to  haws  intsgrabls  singularities.  On  ths  othsr  hand,  if  T  is  large,  ss  would  bo 
tha  csss  whan  s  boundary  Talus  problan  on  a  ssniinfiaits  interval  is  approx inatsd  by 
a  problaai  on  a  finito  intsrral,  than  p  ■  •  nay  ba  nora  appropriate.  For  exaaple, 
if  ly  ■  1  ,  than  HjlB  ■  1  rogardlass  of  T,  whils  llyl,  •  T  ,  and  so,  uss  of 
p  ■  1  would  load  to  linsar  growth  in  T  in  tha  estlnate  (1.4). 

Xt  is  obwious  that  cf  dspsnds  on  ths  aids  conditions.  In  particular,  tha 
problan  (1.1)  nay  ba  wall  conditioned  (i.a.,  haws  X  and  ep  of  acoaptabla  alas) 
while  tha  associated  initial  value  problan  la  badly  eondltlonad  and  rice  versa.  In 
any  ease,  using  tha  initial  value  problan  to  astlaats  the  stability  constants  for 
(1.1)  anounta  to  sstiwating  tha  also  of  |9(t)|  by  |Y(t)l|(BX)-1|  ,  and  this  nay 
wall  ba  a  bad  overestiaata. 

3.  Stability  at  ana-stop  sohanas.  Lot  A  »-  (^jJJ  ba  a  nosh  for  (0,T)  , 

!•••  § 

®  ■  tj  <  ...  <  tg  •  T  . 

for  snob  a  assh,  wa  asa  tha  abbreviations 


\ 


With  say  function  yiM  — >  defined  on  iom  ant  N  containing  A  ,  we 
aasociata  tha  stop  function  £  and  tha  broken  line  y  .  Both  agraa  with  y  on  A  , 
i.a.  i 

y(tj)  “  *  j*o,...,w. 

Tha  function  in  piacawiaa  constant  (in  each  component),  with  breakpoints  tf  , 
... ,  tj,  ,  and  is  continuous  fro*  tha  right,  as  is  Dy  (to  ba  precise  about  it).  The 

As 

function  y  is  piecawisa  linear,  with  breakpoints  t^  ,  t(|_1  ,  and  continuous. 

As  is  customary,  wa  denote  by 

(*n)A 

tha  collection  of  all  n-vactor  valued  aaah  functions  yi  A  — »  *"  .  Wa  identify  each 
such  function  y  with  its  step  function  Interpol ant.  Zn  particular, 

•r>p  -  ■»>,  -  n  bl-i'',i-i*p)1/p  • 

Tat  we  use 


yj  Instead  of  y(tj) 

for  the  value  of  y  at  t  ^  .  We  write  y  instead  of  y  if  we  want  to  stress  the 
fact  that  y  is  a  aash  function.  Finally,  we  associate  with  any  n- vector  valued 
function  y  on  [0,T]  the  real  valued  mesh  function  |y | ^  given  by 
lylA>J  «*  eup  ( I y ( t ) |  i  tj  «  t  ,  j-0,...,w-l  . 

We  approximate  the  solution  of  (1.1)  by  the  aash  function  y  which  satisfies 


with 


V  -  t 

■y  ■  b 


(2.1) 


V  •  y 

(V)j  *“  »  J-o . «-i  • 

■ere,  A^  is  a  linear  asp  carrying  aash  functions  to  aesh  functions.  We  give  ex¬ 
amples  later  on. 

Zn  this  section,  we  are  not  concerned  with  the  details  of  this  approximation  to 
(1.1).  Wo  only  give  suitable  conditions  on  A^  which  allow  us  to  connect  the  stab- 
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ility  of  the  oootinooua  problan  (1.1)  with  that  of  tho  diacrata  problan  (2.1).  Wo 
btfia  with  tho  following 


Condition  If).  Thorn  oxiot  fnnetiono  d,  and  dj  lndnoandant  of  A  auch 

that 

<lhAy  -  h?lAlp  «  dt(h)lyl_  ♦  d3(h)  iL^y  1^  .  for  all  y  «  (rf*)A  .  (2. 

hUfonitlm  1.  Lat  1  <  p  <  •  .  If  Condition  (p)  holda.  than  tha  dlffaaonoa 
atablllty  ralatlan 

•y*.  <  Kllyl  ♦  cp(1  ♦  djIhHlL^lp  ♦  e^HOlyl,  (2. 

holda  for  all  y  «  (rf1)4  .  if  dj(h)  atava  bounded  whila  d1(h)  — »  0  aa  h  — > 
thla  giwaa  a  atablllty  oonatant  for  tha  diacrata  achan  (2.1)  for  all  anffldantlt 
—11  h  •  If  alao  dj(h)  — — >  0  aa  h  — >  0  ,  tha  raaultlna  atablllty  cona»»"t 
approachaa  that  of  tha  oontlnuoua  problan. 

Proof.  For  any  aaah  function  y  ,  wa  hare 

an>  aw 

Ly  ■  t^jf  ♦  Kg  ~  Ay  . 

Thar af or a,  from  tha  diffarantial  atablllty  ralation  (1.4), 

iy«.  -  lyi.  <  *l»y|  ♦  op(«V'p  ♦  >l*^r  -  *ylA»p)  • 

Thla  togathar  with  (2.2)  iapliaa  (2.3).  ||| 

For  any  1  «  p  «  •  ,  condition  If)  la  lapliad  by  tha 

inaal  Condition.  Thorn  axlat  a  function  d1  and  conetanta  d2  and  r  lndapandan 
of  A  auch  that 

l*Ay  -  AylAf j  <  3i(h,,yl- *  *|<rhi,(LAy)il  for  M  y  «<»">*• 

Explicitly,  thla  bocal  Condition  Iapliaa  condition  (p)  with  d,  -  T1/,pd(  and 

dj(h)  “  (2rM)h3j  .  To  derive  thla,  nota  that 

(  I  »  l(Ljr).|)p  <  (UraDh)*-1  J  h.|(bAy).|p  , 

|i-j|«r  1  *  1  |i-j|«r  1  *  1 


therefore 


Mh^y  -  A?lAlp  <  T^^Oillyl.*  ([2rei)h]^*  J  hj  I  ^h1l(L^>ilp)1/p  * 
a ad  the  observation 

I  h .  I  h.|(tAy).|p  <  h  I  I  h.ia-y).!**  <  (ar+DhlL^yl? 
j  i  |i-J|<r  1  A  1  J  1 1- j 1 <r  1  A  1  *  p 

flnishee  the  argunant.  The  Local  condition  also  iaplles  the  following  refined 
stability  eat  lasts. 

irapoeltlw  2.  If  the  Local  Condition  holds,  then  the  difference  stability 
relation 

lyl„  <  KlByl  ♦  o^l  ♦  (ar*1)a2h)tt.^rl,  ♦  cji^hjlyl.  (2.5) 

holds  for  all  y  e  . 

Proof.  Now,  free  (1.2), 

iyl„  <  *l»yl  ♦  c1tt.^ri1  ♦  i/|o(*,s)i  |A^r  -  Ay|  A<s)  dai„  . 

Here,  with  (2.4),  the  last  tem  is  bounded  by 

cJ*i (h) »yi»  +  *  *  /t^1  !«<•'•> I  «■  J 

and.  In  this,  the  last  tern  Is  bounded  by 

dj  naxj  h^  (2r+1)lL^yl1  .  Ill 

■asst.  From  (1.6)  we  see  that  em  <  Tc^ .  Thus  (2.5)  lnproves  the  final  tana 
of  (2.3)  and  aakes  the  h~dapendence  of  the  function  dj  In  (2.3)  explicit. 

The  argunant  for  Proposition  1  Is  easily  reversed. 

Proposition  3.  Let  1  <  p  <  «  .  If  there  exist  functions  e^  and  e2  Indepen¬ 
dent  of  A  such  that 

llA^x  ”  Ay| Alp  <  e^(h)lyl— +  e2(h)lLylp  for  all  y«  (Lp1,tO,T])n  (2.6) 
and  functions  X  and  cp  so  that,  for  all  A  with  h  <  hg  , 
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lyl.  <  K(h0)|By|  ♦  cp(h0)lL^lp  for  »u  y  «  (*"> 


lyl„  <  K(J»0)|By|  ♦  cp(h0){1  ♦  •jthHlLylp  ♦  ep(h0>*i (h)  lyl.  (2.7) 
for  all  y  «  (i/1  3  )B  and  all  A  with  h  <  .  This  provides  a  stability  —  tiarntm 

for  ths  continuous  goblgt  provided  «2(h)  remains  bounded  and  a^  (h)  — >  0  as 
h — >  0  . 

Proof.  Lot  A  bo  any  mesh  with  h  <  hg  and  lot  y  e  (l^1 * )”  .  By  assumption, 
•X1-  *  K<h0>|By|  ♦  o  (h0)lL^I  , 


Thoroforo 


-  (*£.  - A*) 


‘X1-  «  Wh0)|By|  ♦  cp<h0)lLylp  ♦  ep(V  ■l*^L  -  Ayl  A«p  * 


and  tho  bounds  (2.6)  now  allow  tho  conclusion  that  (2.7)  holds,  with  y  thoro 
roplacod  by  y  ,  for  any  sufficiently  fine  A  .  But  then  it  aust  hold  for  y  ,  too. 


.  A  wory  transparent  example  is  provided  by  tho 


scheme.  In  this  schema. 


aAy,j  ’  <LyHtj+1/2>  '  a11  3 


,AAy,J  “  t*y,<tj+i/2)  *  A<  *1+1/2*  2 


Therefore,  on  the  interval  (tj.tj^). 


AAy  -  Ay  "  <Ay,(tj^  -  A?  "  (A<V/2,"A)y  *  A(tj^(',tj^  ‘  y) 


Further. 


y(V/2  "  y<t’  *  U  ’  tJ^/2)yj+ 
yj+  “  (V)j  +  (Ay)(t^/2>  * 


Thus 


l*Ay-AylA<j  <  (ia* lyl—  ♦  J (L^)jl  ♦  |A,.2,y,.)hJ/2  . 

This  shows  that  the  Local  Condition  holds  with  r  •  0,  (h)  -  h(lA* l„  ♦  lx  I  *  )/2 

and  d2  -  liiyj  •  Correspondingly,  the  stability  constant  for  ths  centered  Euler 
scheme  is  within  0(h)  of  the  stability  constant  for  the  continuous  problem  being 
solved. 

It  is  also  possible  to  bound  |a^  -  Ay|  A  in  terns  of  by  .  we  have 

AaX-  Ay  -  (Alt^)  -  A)?<tj4/2>  +  A(?(t^/2)  -  y) 
on  (t^,tjf1)  .  Further, 

y<tj<>/2>  -  y(t>  -  Va£/ts  ♦  Jt3+1  )y' 

and 

y*  -  Ly  ♦  Ay  . 

Therefore 

|AdT*ylA,j  <  ,A,,-V2  ,y,-+  /t3"'’1 1 (iy )<•>!«•  ♦  •A'jyyiJ  • 

This  shows  that  (2.6)  holds  with  st(b)  -  hflA'I,,  +  lAl^J/2  and  e2<h)  -  hlAI J2 
A  slightly  more  involved  example  is  given  by  the  choice 

(v)j  ■ 

with 

^“jk  “  1  ' 

“  0  ,  for  k  e  [0,N] 

■“j.k  ‘V  4  a  * 

For  this  schane  and  on  (tj,tj+1)  , 

V  Ay  Z  «jkA(tj+k)yj+k  -  a; 

-  £  •Jk((*y)(tj+k)  ‘  Ay) 

and 

(Ay)(t)+k)  “  Ay  ■  (A(tj+k)  -  A)y  -  A(t J+k>  (y(t  j+fc)  -  y)  . 

-9- 


) 


now  consider  -  y  •  I*  k  >  0  ,  then 

ytt^J  -  y(t)  -  y^j+k1  "  y<tj+jt_i)  +  •••  *  "  *(t) 

jt-i 


j+v-i ' 


with 


-  l-\  hj+.y,j-  *  (Vrfc)  y*i 

-  t!  V-  l*#'**  ♦iiF<.aj~^<V~ *»  yj— *] ' 

fh  ». 

lVi_t  - 


Hj+m  *" 


A  similar  formats  holds  for  k  <  1  .  From  this,  we  conclude  that  the  local  Condition 
is  satisfied  with  r  -  s  ,  d1(h>  -  h  r2e(lA‘l.  ♦  lAl„2ra)  ,  and  dj  -  rattl.  . 


4.  Belated  considerations.  Certain  discrete  schemes  are  so  closely  related  to 
the  problem  that  it  is  natural  and  advantageous  to  exploit  this  interplay 

directly*  Me  consider  two  specific  instances,  eultiple  shooting  and  algorithms  based 
on  approximating  the  differential  equation* 

In  Multiple  shooting  applied  to  (1.1),  we  are  led  to  the  system 

y>+i  -  *<tj+i)T(V1yJ  -  .  j-o . “-1* 

B0*0  *  Vn  *  b  ' 

with  9j  «■  /tJ+1  T(tj+1)T(s)"1f<e)ds,  all  j.  A  simple  analysis  of  this  system 
can  be  besed  on  the  fact  that  y^  -  y(t^)  ,  with  y  the  solution  to  the  problem 

Ly  -  g  ,  By  -  b  , 


and 


Therefore 


g  »  y(tJ+ir,gJ/hj  on  (tjftj+1) 


y  -  »  ♦  G(*'Vi,dj 


Yl  -  •(t^b  ♦  £ G<t1,tj+1)dJ  . 

Under  suitable  assumptions,  this  leads  to  bounds  for  lyl#  as,  e»g .,  in  Mattheij 
(1981) . 
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As  an  example  of  ths  second  kind  of  Method,  consider  the  approximating  problem 

l<Ay  ■  •  By  -  b  (4.1) 

with  L^y  ■  y'  •  Ay  i  and  A  ,  f  piecewise  constant  approximations  to  A  and  f  , 
respectively.  Since  L^y  »  Ly  +  (L^-L)y  ,  we  obtain 

»y'.  <  ejLyl„  ♦  K|By|  ♦  cjA  -  fcljyl.  .  (4.2) 

Ths  approximating  problem  is  therefore  stable  if 

6.1*  -  AlM  <  1  . 

Often,  em  may  be  quite  small.  Cor  example,  in  many  singular  perturbation  problems, 

A  ■  C/e  and  cB«  4t  , 

therefore  1  -  c^lA-^l^  •  1  -  dlC-fcl^.  In  such  a  case,  we  conclude  from  (4.2)  that 


This  implies  that  the  convergence  of  the  solution  )r  of  (4.1)  to  ths  solution  y 
of  (1.1)  is  uniform,  since  L(yy)  *  -(A-A)j  and  B(yx>  ■  0  ,  therefore 
ly  -  x».  <  -  £*J**yn  -  aic-fc»  . 
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